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Abstract — This paper centers on the limit eigenvalue distribu- 
tion for random Vandermonde matrices with unit magnitude 
complex entries. The phases of the entries are chosen inde- 
pendently and identically distributed from the interval [— n,ir]. 
Various types of distribution for the phase are considered and 
we establish the existence of the empirical eigenvalue distribution 
in the large matrix limit on a wide range of cases. The rate of 
growth of the maximum eigenvalue is examined and shown to be 
no greater than 0(log TV) and no slower than 0(log TV/ log log TV) 
where TV is the dimension of the matrix. Additional results include 
the existence of the capacity of the Vandermonde channel (limit 
integral for the expected log determinant). 

Index Terms — Random matrices, eigenvalues, limiting distri- 
bution, Vandermonde matrices 



I. Introduction 

In this paper we consider random Vandermonde matrices 
with unit magnitude complex entries. Such matrices are de- 
fined as follows, an TV x L rectangular matrix V with unit 
complex entries is a Vandermonde matrix if there exist phases 
0i , ■ ■ ■ ,9l € [— 7r, 7r] such that 
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A random Vandermonde matrix is produced if the entries of 
the phase vector 6 := (6*i,--- ,6l) <E [— 7r,7r] L are random 
variables. For the purposes of this paper it will be assumed that 
the phase vector has i.i.d. components, with distribution drawn 
according to a measure v which has a density on [— tt, tx\. 
In other words, the measure v is absolutely continuous with 
respect to the Lebesgue measure on the interval [—tt, tt]. 

Central to this paper is the probability law of the eigenvalues 
of the matrix VV*, or equivalently V*V, and related matri- 
ces. This work provides results for the empirical eigenvalue 
distribution of the random Vandermonde matrix, in particular 
the existence of the limit measure. The behaviour of the 
maximum eigenvalue is also considered and asymptotic upper 
and lower bounds are obtained in this case. 

Random Vandermonde matrices are a natural construction 
with a wide range of potential applications in such fields as 
finance (22), signal processing (2), wireless communications 
||5), statistical analysis Q, security (6) and medicine (9). 
This stems from the close relationship that unit magnitude 
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complex Vandermonde matrices have with the discrete Fourier 
transform. Amongst these is an important recent application 
for signal reconstruction using noisy samples (see (2j) where 
an asymptotic estimate is obtained for mean squared error. 
This asymptotic can be calculated as a random eigenvalue 
expectation, whose limit distribution depends on the signal 
dimension d. In the case d = 1 the limit is via random 
Vandermonde matrices. As d —> oo the Marchenko-Pastur 
limit distribution is shown to apply. Further applications were 
treated in [ 1 1 including source identification and wavelength 
estimation. 

The article (TJ is the principal reference to date for eigen- 
value analysis of random Vandermonde matrices and this 
paper builds on it. The results mentioned above represent 
some directions in which analysis of random Vandermonde 
matrices were progressed. In particular our results show the 
existence of the empirical eigenvalue measure for certain 
unbounded densities. We are aware of no published results 
for the maximum eigenvalue. 

The rest of the paper is as follows. In Section [II] we give 
a brief overview of random matrix theory. This is followed 
by Section 



III 



which sets up notation and presents some 
preliminary results which are used later in the paper. Section 
[III] is used to prove the existence of the limit measure for 
a wide class of phase distributions with a density. This is 
done via the well known method of moments (8) which 
establishes the existence of the limit measure via Carleman's 
theorem. The expansion coefficient limits are characterized 
both as integrals of products of sine function as well as 
probabilities of certain events involving independent uniform 
random variables. Combinatorial formulas are also given for 
the expansion coefficient of certain classes of partitions. 

This is followed by the upper and lower bounds for the 
maximum eigenvalue of random Vandermonde matrices, see 
Section [V] In Section VI a conjecture for the lower bound 
on the Vandermonde expansion coefficients is stated. We also 
show some of the implications of this conjecture on the lower 
bound on the moment sequence. Applications are discussed in 



Section VII Finally numerical results are presented in Section 



VIII and some conclusions are given. The remainder of the 



proof details are in the appendices. 



II. Random Matrix Essentials 

Throughout the paper we will denote by A* the complex 
conjugate transpose of the matrix A. Ijy will represent the 
TV x TV identity matrix. We let Tr be the non-normalized trace 
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for square matrices, defined by, 



N 



Tr(A) := ^ag, 



where an are the diagonal elements of the N x N matrix A. 
We also let trjv be the normalized trace, defined by trjy(A) = 
■^Tr(A). Given two sequences of numbers {a n } n and {b n } n 
we say that a n x b„ if lim^oo = 1. 

Let us consider a sequence {A^r} NeN of selfadjoint N x N 
random matrices Ajy. In which sense can we talk about the 
limit of these matrices? It is evident that such a limit does not 
exist as an oo x oo matrix and there is no convergence in the 
usual topologies. What converges and survives in the limit are 
the moments of the random matrices. Let An = { a ijis^))f t j=\ 
where the entries ay are random variables on some probability 
space £1 equipped with a probability measure P. Therefore, 



E(tr N (A JV )) 
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and we can talk about the fc-th moment E(trN(Ajy)) of our 
random matrix A^r, and it is well known that for nice random 
matrix ensembles these moments converge as N — > oo. So let 
us denote by ctk the limit of the fc-th moment, 



a k := lim E(tr N (A^)). 
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(3) 



Thus we can say that the limit consists exactly of the collection 
of all these numbers a k - However, instead of talking about 
a collection of numbers we prefer to identify these numbers 
as moments of some random variable A. Now we can say 
that our random matrices A^r converge to a random variable 
A in distribution (which just means that the moments of A^v 
converge to the moments of A). We will denote this by A^v — > 
A. 

One should note that for a selfadjoint N x N matrix 
A = A*, the collection of moments corresponds also to a 
probability measure /i^ on the real line, determined by 



trjv(A* 



t k dp A (t). 



(4) 



This measure is given by the eigenvalue distribution of A, i.e. 
it puts mass A on each of the eigenvalues of A (counted with 
multiplicity): 
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where Ai, . . . , Xn are the eigenvalues of A. In the same way, 
for a random matrix A, /ia is given by the averaged eigenvalue 
distribution of A. Thus, moments of random matrices with 
respect to the averaged trace contain exactly that type of 
information in which one is usually interested when dealing 
with random matrices. 

Example 1: Let us consider the basic example of random 
matrix theory. Let Gjv be the usual selfadjoint Gaussian 
N x N random matrix (i.e., entries above the diagonal are 
independently and normally distributed). Then the famous 



theorem of Wigner can be stated in our language in the form 
that 
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s, where s is a semicircular random variable, (6) 



where semicircular just means that the measure fi s is given 
by the semicircular distribution (or, equivalently, the even 
moments of the variable s are given by the Catalan numbers). 

The empirical cumulative eigenvalue distribution function 
of an N x N selfadjoint random matrix A is defined by the 
random function 

#{k : A fe < x} 



N 



where Afc are the (random) eigenvalues of A(ui) for each 
realization u>. For each lu this function determines a probability 
measure ^at(o;) supported on the real line. These measures 
{/ijv(aj)} w define a Borel measure /ijy in the following way. 
Let B C K be a Borel subset then 

ii N {B) :=E(ji N (u)(B 

A new and crucial concept, however, appears if we go over 
from the case of one variable to the case of more variables. 

Definition 1: Consider N x N random matrices 
Ajy , . . . , A^™-* and variables At, ... , A m (living in some 
abstract algebra A equipped with a state ip). We say that 

(A^ ) ...,A^)-^(A 1 ,...,A ro ) 



in distribution if and only if 

lim E(i^(A$ ) '--A% ) ))=<p(AW'--AM) (7) 

TV— foo V V / / 

for all choices of k, 1 < «i, . . . , ik < m. 



The A\ , . . . , Am arising in the limit of random matrices 
are a priori abstract elements in some algebra A, but it is 
good to know that in many cases they can also be concretely 
realized by some kind of creation and annihilation operators 
on a full Fock space [29]. Indeed, free probability theory 
was introduced by Voiculescu for investigating the structure of 
special operator algebras generated by these type of operators. 
In the beginning, free probability had nothing to do with 
random matrices. 

Example 2: Let us now consider the example of two inde- 
pendent Gaussian random matrices G^,G^ (i.e., each of 
them is a selfadjoint Gaussian random matrix and all entries 
of G^ are independent from all entries of G^' ). Then one 
knows that all joint moments converge, and we can say that 



(G#,G$)->( ai , a2 ), 



(8) 



where Wigner's Theorem tells us that both si and S2 are 
semicircular. The question is: What is the relation between 
si and S2? Does the independence between G^ and G^ 
survive in some form also in the limit? The answer is yes and 
is provided by a basic theorem of Voiculescu which says that 
Si and S2 are free. For a formal definition of freeness and 



more results in free probability see (29], (28), |26|, (27] and 
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Let {D r (7V)}™ =1 be a set of non-random diagonal L x L 
matrices, where we implicitly assume that % — > c. As we 
previously discuss the family has a joint limit distribution as 
N -> oo if the limit 



A: 



lim trr/D^iV^-D^iV)) (9) 
exists for all choices of i\, . . . , i s E {1, . . . , n}. 



III. Vandermonde Expansion Coefficients 

We will denote by Vin) the set of all partitions of 
{1, . . . ,n}, and use p as a notation for a partition in V(n). 
Also, we will write p = {B\, . . . , B r }, where Bj will be used 
to denote the blocks of p and r is the number of blocks in 
p. Let lj = {iji,ij2, ■ ■ ■ , ij\B \} be the set of elements in the 
block Bj. We denote by D p 



D P =\{Db 3 



where 



D, 



Di 



(11) 



Consider anJVxi random Vandermonde matrix with unit 
complex entries as given in equation ([TJ. We will be consider- 
ing the case where the phases d\ , . . . , 6l are independent and 
identically distributed taking values in [— tt, tt]. The variables 
9i will be called the phase distributions and we will denote 
by v their probability distribution. It was proved in [ 1 1 that if 
dv = f{x) dx for f{x) continuous in [—tt, tt] then the matrices 
V* V have finite asymptotic moments. In other words, the limit 



lim E 

JV-s-oo 



tr L 



((V*V) n 



i c) 

exists for all n > 0. Moreover, m n is equal to 



pEV(n) 



(12) 
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where K pu are positive numbers indexed by the partitions p. 
We call these numbers Vandermonde expansion coefficients. 

The fact that all the moments exists is not enough to 
guarantee that there exists a limit probability measure having 
these moments. However, we will prove that in this case 
this is true. In other words, the matrices V*V converge in 
distribution to a probability measure p c supported on [0, oo) 
where c = lim -fe as the dimension grows. More precisely, 
let pl be the empirical eigenvalue distribution of the L x L 
random matrices V*V. Then p^ converge weakly to a unique 
probability measure p c supported in [0, +oo) with moments 



t n dp c (t). 



We also enlarge the class of functions for where the limit 
eigenvalue distribution exists to include unbounded densities 
and we found lower bounds and upper bounds for the maxi- 
mum eigenvalue. 

Even though these numbers are indexed by the set of 
partition V(n) they do not have the properties of classical 
cumulants (these latter are the coefficients of the log charac- 
teristic function). Instead these numbers are weights which tell 



us how a partition in the moment formula should be computed. 
They are also to be distinguished from the free cumulants in 
free probability theory which are the coefficients of the R- 
transform (see |28| and |29| for more details on this). 

Let p be a partition of the set {1,2,..., n} with r blocks. 
Consider the map p : {1, 2, . . . , n} {1, 2, . . . , r} such that 
p(i) — k if and only if i is in block k. The analysis done in |TJ 
and [2 1 with respect to these coefficients can be summarized 
as follows, 

(14) 
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where 
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p,u,N 
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(10) with 



and 



F p (xi, . . . , x r ) dx\ . . . dx r 



F p (xi,...,x r ) := Y[F(x p{j) -x p ( j+1) ) 

sin(fx) 
HX) sin(f) ' 



Consider a random Vandermonde matrix defined as before 
with phase distribution v concentrated in the interval [— 7r, tt]. 
For each q > 1 let L q (\— tt, tt}) be the class of all the q- 
integrable functions with respect to Lebesgue measure. We 
will denote by C := P\ q >iL r ([— tt, tt]) the space of all q- 
integrable functions. Note that L°°([— tt, tt]) C C. Further 
denote by A those probability measures supported on [—tt, tt] 
with non-negative Fourier series coefficients. More specifi- 
cally, 



4>{m) 



' dv(t) > 



for all m € Z. 



Theorem 1: If v is a probability measure which is abso- 
lutely continuous with respect to Lebesgue measure and with 
probability density p with p E C n A, then for each partition 
p the expansion coefficient K Ptl/ exists. Moreover, if p is a 
partition of n elements with r blocks then 



K P ,v = K P ,u ■ (2tt)^ ■ / p(x) r dx 



(16) 



where K p u is the expansion coefficient with respect to the 
uniform distribution. 

The proof of this Theorem can be found in the Appendix. 

Remark 1: A close look at the proof of this Theorem shows 
it is enough for the proof to work that the following holds, 



n k to «)i < °° 

mSZg 71=1 

for every k > 1 where 

Zp := {(mi, . . . ,m k ) : mi + . . . + m k = 0} 



(17) 
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and 



a(m) :=E(e imf,fc ) 



c p(a:) dx. 



The case fc = 1 is trivial and k = 2 is essentially Parseval's 
identity. However, for k > 3 the condition of p being in £ 
alone is necessary but not sufficient as was pointed out in 
D34I . Consider for instance a random sign function at scale 
for some N, i.e. a function of the form 



N-l 



/N,(n+1)/N) 
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for some i.i.d. signs e n . This function is bounded in every L q 
but Khintchine's inequality tells us that the first N Fourier 
coefficients of this function are of size on the average, 

ViV ° 

which will lead to the divergence of the above series for k > 3 
in the limit N — > oo. One can formalize this divergence by 
creating a suitable linear combination of the above samples 
over all N, or appealing to the uniform boundedness principle. 

The following proposition give us an alternative way to 
compute the Vandermonde expansion coefficients. 

Proposition 1: The Vandermonde mixed moment expansion 
coefficient K p>u can also be written as 



Kn 



G p (xi, . . . , x r ) dx\ . . . dx r 



where 



and 



G p (xi, . . . , x r ) := Y[ G(x p (j) - x pU+i)) 

3=1 



(18) 



(19) 



G(x) 



sin(7rx) 



Fig. 1. Density pi (8) as in Example 3. As we observed this density does 

2 

not meet the convergence criterion. 



We now provide an example of an unbounded pdf living in 
the family C n A for which Theorem [T] applies. 

Lemma 1: Suppose that / E L x ([— 7r,7r]) is a symmetric 
density around 0, convex and decreasing on (0, 7r]. Then the 
Fourier series coefficients are non-negative. 

Proof: The Fourier series coefficients exist since / 
is an integrable function by hypothesis. By the symmetry 
hypothesis the Fourier coefficients are real and equal to 
2 J Q f(x) cos(mir) dx for m E Z. Note that since f(x) is 
even it is enough to verify the claim for m > 1. Since convex 
functions are differentiable a.e., see fl24) , integration by parts 
applies yielding 



f{x) cos (ma:) dx = 



sin(mx) 



fl{x) Mrnx) dx _ 



The proof of this proposition follows easily from equation 
©■ 

Remark 2: Note that in the previous Proposition we need 
to integrate only with respect to r — 1 variables even though 
G is a function of r variables. The reason for this is that G is 
a function of the differences. 

The following is an example of a family of probability 
distributions that do not belong to the family C, see also jTJ. 



Example 3: Let < a < 1 and let 



Pa(x) 



1 



1 



Then it is easy to see that 



(20) 



p(x) dx — 1 



and 



p{x) n dx < +oo 



< n < -. 
a 



The density is depicted in Figure [T] for a = |, so the limiting 
expansion coefficient does not exist for n > 2. 



The first term is under the assumption that / E L 1 
(lim I _ i .o xf(x) = 0) and the last term is positive since 
—f'{x) > and it is decreasing due to the convexity. ■ 



Example 4: We now show that the unbounded pdf defined 



as 



1 7T 

2^ l0g R 



(21) 



does satisfy 



(f(x)) n dx < oo, 



for all n > 0. To see this first note that / is convex on (0, 7r]. 
It follows that the infinite Riemann sums for Xk = r , k = 
1, 2, 3, • • • give rise to the following double inequality for the 
integral of /, 



E 



f(ky 



< 



=; Hk + 1) y 



(f(x)) n dx< 



i)' 



k(k + 1) 



< oo 



for all n > 0. Therefore f E C. Applying the previous Lemma 
we see immediately that / also belongs to the family A 
and hence Theorem [T] applies to the probability distribution 
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Fig. 2. Unbounded density f(8) as in Example 4 for which the limit 
eigenvalue distribution exists. 



with density f(x). Moreover we can compute its Fourier 
coefficients as 



f(m) 



7T Si(|m|7r) 

log — cos(ma;) dx — — ; — ; 

o x \m\TT 



where 



Si(t) 



sin(a;) 



dx > 



for all t > 0. The density itself is depicted in Figure [2] 

An important consequence of Theorem [T] is that it gives the 
uniform phase distribution a distinctive role. See also [ 1 1 for 
an alternative proof of the following Proposition. 

Proposition 2: Let V„ denote a random Vandermonde ma- 
trix with phase distribution v, and set 

m„, B := lim E [tr £ ((V* V„) n ) • 

N— J-oc L V / . 

Then we have that for all n > 1 

Proof: It is enough to prove that for every partitions p e 
V{n), with an arbitrary number of blocks r, i^p« < Kp,v By 
the previous Theorem 



K, 



(r-1) 



p(a;) r da;. 



By Jensen's inequality 
1 



2?r 



p{x) r dx = E(p(x) r ) > E(p(x)) 



2tt 



Therefore, (2n) r 1 f* n p(x) r dx > 1 and it follows that 

Using Theorem [T] and Theorem 1 from JT] we can state the 
following result. 

Theorem 2: Assume that {D r (iV)}i< r < n have a joint limit 
distribution as N — > oo. Assume also that v satisfies the 
hypothesis of Theorem [T] Then the limit 



exists when — > c and is equal to 

pGV(n) 



(22) 



In the following examples we will compute K p u for some 
families of partitions. 

Example 5: Let n even and let p be the partition 

/9 ={{l,3,...,n-l},{2,4,...,n}}. 

Then by Proposition [T] 

K p , u = f + G(x-y)^G(y-x)^ dx= (g? *G%)(0) 

J — oo 

where G(x) = sm j^ x ^ ■ Alternatively, since G(x) — G(—x) 
we can write 

This integral can be easily computed giving us the following 
result: 



S— l 



fc=0 



n-1 



(23) 



Evaluating the last expression we see that i4T{{i > 3},{2,4}},« = | 

and ^{{l,3,5},{2,4,6}},« = 20' 

Example 6: Let n > 1 and consider the partition 
p = {{l,n + l},{2 1 n + 2},...{n, 2n}} 
then p E V(2n) and |p| = n. Then 

/ TTG(a;i - x i+ i) 2 dxi . . . dx n -i 
f=i 

'g 2 *G 2 * ... *G 2 )(0). 



Using the fact that the Fourier transform of G' 2 (x) is the 
triangular function tri(t) := max(l — |t|,0) and elementary 
properties of the Fourier transform we see that 



K — 



+oo 



for all n > 1. 



M n = limE 



tr L (Di(^)V*VZ)2(A r )V*V . . . D„(7V)V*V 



IV. Bell Numbers, Harper's Theorem and 
Existence of the Limiting Measure 

The numbers B n are defined to be the Bell numbers, i.e. the 
number of possible ways in which the set {1, • • • , n} (or any 
set of size n) can be partitioned into distinct subsets. Further 
define s(k, n) to be the Stirling numbers of the second kind, 
i.e. the number of partitions of a set of size n into k subsets. 
By definition 

n 

^ s(k,n) = B n . 
k=i 
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If we normalize the s(k,n) by B n we obtain a probability 
distribution. The following result establishes the asymptotic 
normality of this distribution. 



Theorem 3: [Harper] |18| The Stirling numbers of the 
second kind are asymptotically normal in the sense that 



1 



->• 



3=1 



2tt 



e 2 dt as n 



where x n = cr n x + (B n+1 /B n - 1) and a n = (B n+2 /B n - 
(B n+1 /B n ) 2 

Moreover, if we define J n the integer such that s(J n ,n) 
maxi<i<„ s(i, n) then J„ > 

s(J„,n) 



e log 71 

1 



and 

B,, 



'2n cr„ 



Therefore, by Carleman's Theorem flO) there exists a unique 
probability measure \i c supported on [0, +oo) such that 



M = 



+ 00 



t n dfi c (t), Vn>l. 



(c) 

In other words, the sequence m£,,ra is distribution determining. 
Indeed, let /i l be the empirical eigenvalue measure distribution 
of the Lx L matrix V*V. We have thus proved the following 
result. 

Theorem 4: The sequence of distributions /jl converge to a 
unique limiting distribution fi c for which all positive moments 
exist and if A is a positive random variable with distribution 
fj, c then for all n > 1, 



E[A n ] 



Remark 3: We would like also to point out that as a 
Corollary of Lemma 2 in fl8) 



limtTn = 1. 

n 

This result will be used later on this work. 

An estimate of de Brujin (1981), and also an estimate of 
Moser and Wyman |TTi] states that, 

/ n in \ 

B n x exp n log n—n log log n— n+ log log n+ . 

\ logn logn / 



It follows that 



B r r x exp log n — log log n — 1 • 



1 



log log n 
log n log n 



< n. 



Let V be an N x L random Vandermonde matrix with phase 
probability distribution v. Assume also that v is absolutely 
continuous with respect to Lebesgue measure and with con- 
tinuous density p(x). It was proved in Theorem 3 of [1] that 
the Vandermonde expansion coefficient K p v exists and that 

:= lim E[tr L ((V*V) n )l = V Kp.J^ 1 (24) 

for all n > 1. However, this is not enough to guarantee the 
existence or uniqueness of probability measure supported in 
[0, +oo) having these moments. Let p 6 V(n) be a partition 
with r blocks then 



K PtV = K PtU ■ (2tt) 



(r-l) 



v{x) r dx<{2-K-\\p\\ oo y 



since < K pu < 1, Therefore, 

ml% < (2vr ■ HplU • max{c, 1})" ■ B n 
for all n > 1. Let C = (2ir ■ \\p\\oo • max{c, and define 

/3 n := inf f m^H 2fc < C • inf Bj* < C ■ inf \/fc = C • Vn. 

Hence, ft^ 1 > C^ 1 ■ nT 1 / 2 and therefore 



V. Maximum Eigenvalue 

Let V be a square N x N random Vandermonde matrix 
with phase distribution v. In this Section we will focus on 
the study of growth of the maximum eigenvalue of the matrix 
V*V as a function of N. More specifically, we know that the 
matrix V* V is a positive definite N x N random matrix with 
eigenvalues {Ai < A2 < . . . < Xn}- It is clear that Xn is a 
random variable with values in the interval [0, N]. The value A^ 
is taken by the random variable Xn in the event in which all the 
phases in the random matrix are equal (#i = Q% = . . . = On) 
and this event has zero probability. First we will prove an 
upper bound on the expectation E[Ajy]. 

Note that, of course, such a study does not rely on the existence 
of a limiting measure. 

A. Upper bound 

We first note that the matrix V*V has the same eigenvalues 
as the matrix 



'sin(f (0j-0j)) 
, iVsin(^) , 



l<i,j<N 

See Appendix A for a proof of this statement. It is a well 
known result in Linear Algebra (see fT7) ) that 

Xn < (max{ci} max{ri}) 5 

i i 

where Cj and r; are the l\ norms of the columns and rows of 
the matrix. In this particular case, 



and 



N 

3=1 

N 
3=1 



S i n (f(^-^)) 



TVsin(^i) 



sin(f (Oj-Oi)) 



'-) 



E^ 1 = +°°- 



n=l 



Therefore, it is the case that = Cj and the maximum 
eigenvalue satisfies 

Xn < max{fi : i — 1,2, ... , N}. 
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For each i G {1,2,..., TV} the random variable has the 
same distribution as the random variable 

Y = 1 + X l + X 2 + . . . + X N _ X 

where X\, ■ ■ ■ : Xn-i are independent identically distributed 
random variables conditioned to the phase 0j. Moreover, each 
Xk has the same distribution as 



X{6) 



sin(f 9) 
TVsin(f) 



where 8 is distributed accordingly to v 



conditioned on the phase Oi. We will assume that v is a 
probability measure on [—%, %] which is absolutely continuous 
with respect to Lebesgue measure and with bounded pdf / G 
L°°{[— 7T, 7r]). In what follows the Chernoff bound construction 
will only make use of ||/||oo an d hence is independent of 0j. 

Remark 4: The random variable X (6) has expectation 



E(X(6)) = 
and second moment 

E{X(6) 2 ) = 



f 


sin(f0) 


J —7C 


iVsin(f) 




sin(f ff) 


> —TV 


iVsin(f) 



f(9)d6 



f(9)d6. 



In case v is the uniform distribution then f(ff) = J- and using 
the results on the integral of the Dirichlet kernel (see 1 19 1) we 
see that: 

log N 

E(X(9))x^f. 

Using Parseval's Theorem it is straightforward to see that 

1 



E(x(ey) 



N' 



Theorem 5: Given e > and k G (0, 1), then for every 
u > 0, there exists TV = N(n, e) such that for all N > N(k, e) 



X N > (C* + e)logiV + u) < K 



N eK 



(25) 



where K > is a constant independent on e,k,u and TV and 
C=(47r||/|U(e-l) + l). 

Note that for e = 1 + S with S > the result implies that 
An > (C + e) log TV occurs finitely many times a.s. by the 
Borel-Cantelli Lemma. 



As a Corollary we have: 

Corollary 1: 

E(\ N ) < (47r||/||oo(e-l) + l) logJ\T + o(l). 

We will first prove Theorem [5] 
Proof: It is easy to see that 

N/2 



(26) 



Mm) 



N sin 



M ■ 



< 



E 

k=l 



■ 1, 



(N) 



(27) 



for every x G [— 7r,7r]. Let us define p/. = ^([ 27r ^ 1 - ) , ^S^]) 
and p^ k ■= ~ 2 * ( N ~ 1) }) and let q k = p k + p_ k for 

every k = 1, 2, . . . , ~. 
Hence, for every t G [0, 1] 

N/2 N/2 



E{e xt \6i) <Y,dkei <l + ( e -l)^ 



fc=l 



k=l 



where the first inequality comes from ( |27| ) and the last 
inequality comes from the fact that e* < 1 + (e — l)t for every 
t G [0, 1]. Since m&x k {pk,P-k} < 77H/H00 we conclude that 

47r(e-l)||/||, 



E(e 



< 1 



N 



H 



N/2 



(28) 



where H p := Y^k=i S i s tne Harmonic series. 

The random variables r, all have the same distribution as 



X 



N-l 



where {X±, . . . , X^^i} are i.i.d. conditioned on the phase 
8i. However, the r, are not independent. Using the Chernoff 
bound with the random variable Y, unconditioning and setting 
t = 1 (see (T5}) we see that: 

P(Y > Clog(JV) + u|0i) <E(e x |6» 4 ) JV -e-( c '' 5losAr+u ) 
47r(e-l)||/|| c 



N 



< 



1 



• H 



N/2 



n Cs y 1 n 

This follows from the bound on the conditional moment 



generating function (see equation 28 I. Here Cs = C — S and 
5 > 0. Let Ns be the minimum positive integer such that the 
following inequality holds SlogNg > 1. Then for all TV > N$ 
and unconditioning we see that 



Y > Clog(TV)+u < 



1- 



Me- 1)11/11 



A' 



NCs \~ 1 TV 
For any positive function / : N — > [0, +00) 



■H 



N/2 



1 



N 



exp 



TV log 




< exp(/(TV)) 



where the last inequality comes from the fact that log(l + a;) < 
x for all x > 0. 




N/2 



< exp 



47r(e-l)||/|| 0O -ff JV/2 



and since H p < \ogp + 7 + hp 1 where 7 is the Euler- 
Mascheroni constant 7 w 0.57721566... 



exp 



Me-lJU/Hooftys 



< JC-exp 



47r||/|| 00 ( e -l)log(7V/2) 



where K = exp(47r||/|| 00 (e - 1)7). 
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Let us define the random variable Z as Z = maxfejrfe}. 
Therefore, 

P(Xn > ClogN + u) < ¥{Z> ClogN + u) 

< N¥(Y > C log N + u) 

where the last inequality comes from the union bound. Hence, 
for all u > we have 



P(Aat> ClogN + u) < ^L-Ke- U l^ 



4T||/IU(e-l) 



< K 2 e' u N^ f ^ e ^ +1 ' Cs \ 

Let e > and k € (0, 1) be given. Set 5 = e(l - re) > and 
set C = 47r||/|| 0O (e — 1) + 1 + S so that for every u > and 
N > Ns where S = en 



P(A W > (C + e)logN + u) <K 2 



N eK ' 



Now we follow with the proof of the Corollary. 

Proof: Using the previous Theorem we have that, 

E(X N ) = / ¥(\ N >t)dt< / ¥(X N >t)dt 
Jo Jo 

¥(X N > ClogN + u) du 

hi 

K 2 



< 



(47r||/||oo(e-l) + l) log N + 



ATe/2' 

for sufficiently large N. 

Since K 2 does not depend on N and e is arbitrary we conclude 
that for TV sufficiently large 

E(A*) < (47r||/||oo(e-l) + l)logJV + o(l). (29) 



Remark 5: For the case v is uniform distribution on [—n, n] 
we have that 



E 



(Ajv) < foe- l) logiV + o(l). 



(30) 



Remark 6: We believe that the constant C in Theorem [5] 
can be sharpened by working with the optimal choice for t. 

B. Lower Bound 

The main result we will derive in this Section is the following. 

Theorem 6: Let v be an absolutely continuous probability 
distribution on [— tt, n] with continuous probability density. Let 
A at be the maximum eigenvalue of the random matrix V*V 
generated accordingly to v. Then for any < a < 1 



a ■ log N \ 



In the proof we will need the following result which was 
proved in 1 23 1 . 



Theorem 7: Let a > and b > and suppose that there are 
aN balls and bN urns, and we throw the balls independently 



and uniformly at random in the urns. Let M be the random 
variable that counts the maximum number of balls in any urn. 

Then ¥{M > a-k N ) = o(l) if a > 1 and P(M > a ■ k N ) = 
1 - o(l) if < a < 1, where k N = log N/ log log N. 



For additional results along these lines, see (23]. We would 
like to remark that the estimates in |23) can be also derived 
via the maxima of unit Poisson random variables and a natural 
construction for the occupancy experiment. 

Proof: Let & be a positive integer to be chosen later. 
Divide the interval [0, 2if\ into bN intervals of the same length 
fe. These intervals will represent the urns and the angles 
8i,02, ■ ■ ■ ,&n will represent the balls we will throw into the 
urns accordingly to the distribution v. 

We will now develop a lower bound for the maximum 
eigenvalue, A^v- Let f(x) be the continuous function such that 
dv(x) = f(x)dx. Let xq be such that /(xq) > 0. Given 6 > 
let e > be such that \f(xo) — f(y)\ < S for all y such that 
\xq — y\ < e. Let K e be defined as 



K, 



f(x Q +t)dt> 0. 



Using the Strong Law of large numbers we know that as N in- 
creases we will have K t N angles in the interval (x n — e, x +e) 
with probability 1 — o(l). Choosing S sufficiently small we 
can assume without loss of generality that / is constant in 
this interval. Since we divide the interval [0, 2ir] into bN 
intervals we know that —bN of these intervals will lie inside 

7T 

(x Q — e,XQ + e). Therefore, we have the game were we 
throw K f N balls into -bN urns with uniform distribution. 
Therefore, using Theorem [7] with high probability we will find 
at least K = a ■ fcjv distinct 0f. x , ■ ■ ■ , 6k K with the property 
for 

\O kj -0k e \<^, l<k,£<K (32) 

where, of course the constraint holds when the two indices are 
the same. 

Consider now the square real symmetric submatrix with rows 
and columns corresponding to the above indices, fci, • • • , kx ■ 
Let S be this matrix. Note that up to reenumeration of the 
angles we can assume without loss of generality that S is the 
K x K principal minor. Let Fff be the function defined by 



F N (x) 



sin (fx) 
Vsin(f) 



Let 7 > and small and choose b sufficiently large so 

^W)>l-7 



(31) for all N. The entries of S are all positive since 



Sk,e — F, 



- 9 t ) > F 




> 1 



7- 



Let As be the maximum eigenvalue of this matrix. By stan- 
dard Perron-Frobenius theory this eigenvalue is positive and 
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satisfies, 



Xs>K-F N l^\ >(l-7)#. 



A further standard result, see [30) , is that the eigenvalues of 
a real symmetric matrix and its square submatrices interlace. 
It thus follows that for any < a < 1 with high probability 
we have: 

log N 

Ajv > A s > (1 - 7) a 



log log TV 



(33) 



More precisely, 



f L> aM =i-o(i). 
^ - logiogiv y v ; 

Now since 7 is arbitrary we proved our Theorem. ■ 

C. Remarks on the Upper Bound 

In this Section we would like to observe that the results 
obtained in Theorem [5] are not valid if the pdf is unbounded. 
Consider the probability density given by the following pdf: 

l-a 1 



p a (x) 



27T 1 

Then if we define p^ as 



-a ' \ x \a ' 1 [-k,k]( x )- 



(34) 



Pn '•- 



p a {x) dx 



\2NJ 



( 



By the Strong Law of Large numbers the expected number 



JV° 



27V ' 2N J 



of the angles 81, ... ,8^ in the interval 
Therefore, repeating the same argument given in Theorem [6] 
we have: 

Theorem 8: Let < a < 1 and let p Q be the pdf 



given in equation (34i then if we consider V the random 
Vandermonde matrix constructed according to p a and let 
be the maximum eigenvalue of V*V we have that 



Xn > 



1 N a 



2 2 1 



l-o(l). 



VI. Conjectured Lower Bound on the K p , u 

Given p € V(n) we would like to find a lower bound for 
K PlU in terms on n and the size of the blocks of p. This will 
immediately give us a lower bound on m n . But first let us fix 
some notation and review some preliminary results. Following 
the definition in 1 161, (2;)+ is if x < and is x k otherwise. 
The density of the sum of m i.i.d. uniform distributions in the 
is 



interval r 1 1 



2 ' 2 J 



1 



m—1 



(m- 1)! ^ 



{-If 



m 
k 



t+--k) 



The following Lemma will be used subsequently. 

Lemma 2: Suppose that p < m < n then the following 
inequality holds 

/•oo 

/ 9 (m ~ p) (t)g (p) {t)g (n ~ p) (t) dt > g w (o) ff w (o) 



See Appendix for the proof of this result. 

Remark 7: The sequence {g^ n \0)} n is decreasing and us- 
ing the Central Limit Theorem we can prove that g(") (0) x 
h n — 7/= 77=- We also want to emphasize that this approxi- 
mation is good even for small values of n, 

V3 



5 (2) (0) = 
3 (3) (0) = 
3 (4) (0) = 



hn = 



V3_ 



0.9772 



0.7979 



0.6910 



As it was noticed in (Tj, each partition p € V{n) with r 
blocks determines a set of r equations E 1} E 2 , . ■ . , E r in n 
variables Mi, M2, ■ ■ ■ , M n . These equations have rank r — 1 
and satisfy that 



£1 + £2 + 



E r = 0. 



Repeating the analysis done in Appendix B of (T) we know 
that K PtU can be expressed as probability (or volume) of the 
solution set 



E, 



J2 Mi = M i-i> 



(35) 



i£Bj 



ieB, 



with — I < Mfe < \ independent and uniform random 
variables. It was also observed in [1] that the probability of 
this set is always a rational number small or equal than 1 and 
that K p u = 1 if and only if the partition is non-crossing. 

A. Case r=2 

In this case we have only two blocks and p = {Bi,B 2 }. 
Therefore we have n i.i.d. uniform distributed random vari- 
ables {Mk}i<k<n and K PtU is the probability of the set that 
satisfies the equations: 



Ex : M - 



eBi ieBx 



and 



E 2 : J2 U - = Y, - U < 

iGB 2 iGB 2 



Since E\ + E 2 = we need only to satisfy one of them. 
Without loss of generality we can assume that k = \Bi\ < 
\B 2 \ = n — k and let 2m be the set of variables appearing 
in both sides of equation E\ (after possible cancellation of 
variables). Note that m < k and m = k if there is no 
cancellation in E\. Then 



sin(7ric) 



„ = (G m *G m )(0) 

Since the continuous Fourier transform 



where G(x) 

of the normalized sine function (to ordinary frequency) is 
g(t) = ij(t) we have that 

"+C30 



K — 



(g^) 2 (t)dt = g( 2m \0) 
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where 



g( m \t) = (g*g*...*g)(t). 



Since the sequence {g^ n \0)} n is strictly decreasing we have 

X p ,„=. g ( 2m >(0)> 5 ™>(0) 



B. Case r=3 

Let us first motivate this case with an example. 
Consider partition p E 7 , (10) given by p = 
{{1,5, 7}, {3, 9, 10}, {2, 4, 6, 8}}. We only need to consider 
two of the three equations. Let us consider the ones associated 
with the smallest blocks, in this case B\ and B 2 . Then the 
corresponding equations are: 

Ei : Mi + M 5 + M 7 = M w + M 4 + M 6 



and 



E 2 : M 3 + M 9 + M w = M 2 + M s + M g . 



After cancellation and arranging common variables to both 
equations on the same side we obtain: 



and 



Mio = Mi + M 5 +M 7 + N 4 + N 6 



Mio = M 2 + M 8 +N 3 



where Nj = —Mj. Note that by the way we arrange the 
variables there is no common variable in the RHS of the 
previous equations. Therefore, it is clear that 

/+oo 
g(t)g^(t)g (3 \t)dt. 
oo 

Therefore, using Lemma [2] we see that 

^p,u>g (6) (0).g (4) (0). 

Note that 5 (6) ((% (4) (0) is equal to product of the probabil- 
ity densities for the set of i.i.d. uniform random variables 
Xi, . . . , X 6 ,Yi, . . . , Y4 satisfying equations Xi+. . .+X 6 = 
and Yi+. . .+I4 = 0. Since the sequence 

{ff (n) (0)}n is strictly 

decreasing we proved that 

^p,u>5 (2|Bi|) (0).9 (2|B2|) (0). 



It is clear that the same argument described in the previous 
example can be carried out in general. Hence, if p 6 V(n) 
with 3 blocks such that \Bi\ < \B 2 \ < \B 3 \ then 

^p,u>5 (2|Bi|) (0).9 (2|B2|) (0). 



C. Conjecture on the General Case 

Several numerical simulations and examples strongly suggest 
that the following conjecture is true. 

Conjecture 1: Let p £ V{n) be a partition of n elements 
with r blocks of size rii < n 2 < ... < n r . Then 

r-l 

K p . u > Y[g {2n ^(0). 

i=i 

If the previous conjecture holds then using Remark [7] we have 
that for n sufficiently large 



K p , u >Y[g^H0)*Y[h 2nj 



G 

7T 



r-l 

1J ; ^/2n 



(36) 



By the Arithmetic and Geometric mean inequality 

fm + ... + n r _i\ ( n \ 

m-«r-i< — x Mr^T • 



Therefore, 



r-l 



< 



1 



y/ni ■ ■ ■ n r -i 



Hence, plugging the previous inequality in equation ( |36] l we 
obtain 



3(r-l) 



(37) 



Let us define L(k,n) := 



_ ( 3(fc-l) 



. Then the previous 
conjecture implies that K P:U > L(r,n) for any partition of n 
elements with r blocks. On the other hand, it was observed 
in (2) and pi that K p u = 1 if and only if the partition is 
non-crossing. Let T(k, n) be the Narayana numbers i.e., the 
numbers of non-crossing partition of n elements in k blocks. 
It is known that 



T(k,n) 



k\k- l) U-l 



see |3T) . Therefore applying the previous analysis we have the 
following lower bound for the n-th moment: 



C„ + n) — T(k, n)) ■ L(k, n) < m n 



(38) 



k=l 



where 



s ( fc '") = M^ ( - ir (!) ( ^ z)n 



i=0 



is the Stirling number of the second kind and C n = ( 2 ^) is 
the Catalan number which counts the number of non-crossing 
partitions of n elements. They also arise as the moments of 
the semicircular distribution as in (|6j. 

Assuming that Conjecture [T] is true and using Harper's The- 
orem p8) it can then be shown that the following Theorem 
holds. 
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Theorem 9: Let B n be the n-th Bell number, a n = 

(B n+2 /B n - {B n+1 /B n ) 2 - 1)' then 



1 B„ 



^2n cr n \ ne log n 



< m„ < B^ 



Moreover, 



lim 



B„ 



(39) 



(40) 



Proof: Since m„ = J2 P ev(n) k p-m and since L(B,n) < 
Kp,u < 1 for any partition with B blocks we see that m n < 
B n (as was already noted in |TJ) and 

n 

^2s(j,n)L(j,n) < m n 



which is a weaker inequality than Equation (38 1. It is clear 
that s(J n ,n)L(J n ,n) < Y^j=\ S (J> n )L(j, n). Using Harper's 
Theorem we see that 



s(J„,n) 



1 B„ 



2ir o n 



and 



L(J n ,n) 



3( J n - 1) 



e log n 



we log n 



Hence proving equation ( 39 1 



To prove the second part of the Theorem we first note that 
since m„ < B n then 

On the other hand, using equation (|39|) we have 



mn > 




1 \" / 3 \ 2eIog " B n Y f 1 \ 2cIOE ' 



V27r I \tt I \ (J n I \elogn 

Since lim„ (^=^j " = lim„ 2clOE " = i an( j 

1 \2¥i5^r / log log nN 

= limexpl 

n \ 



lim 



n \e log n 
We have that 



logn 



lim sup 



> lim sup 



1 



= 1 



n \ (J% 

where the last equality comes from Remark [3] ■ 

VII. Capacity of the Vandermonde Channel 

Consider the Gaussian matrix channel |20"1 in which the 
received signal y E C N is given as 



y = Hx + z 



(41) 



where z - CM(0,I N ), x - CAT (0,I L ), and H e C NxL 
has i.i.d. zero mean Gaussian entries and is standard see 



Then an explicit expression for the asymptotic capacity exists 
1331: 



lim -j-logdet(/Ar + 7 Hir 

N-HX N \ 



loge 

47 



+ log (l + 7 - ^(7, /?)) + log (l + Pl- \f(j, /?)) 
where 

F(a,b) :-- 



a(l + Vb) +1 



a 1 



^) 2 + l^ 



and the SNR 7 is 



and the ratio 



JV 



= ^-E[||x|| 2 ] 

7 i-E[|N| 2 ] 

P as N — > 00. 



We can prove that a similar limit exists and is finite if the 
Gaussian matrix H is replaced with a random Vandermonde 
matrix. Moreover, using Jensen's inequality we can get an 
upper bound on the capacity. More precisely, if we fix 7 > 
to be the SNR, we may define Cv{l) the asymptotic capacity 
of the Vandermonde channel (whenever the limiting moments 
exist and define a measure) for random Vandermonde matrices 
V G C NxL to be 



CV( 7 ) 



lim El— log det (l N + 7VV* 

N->oo \ N V 



lim E — logdet(/ L +7V*V| 

JV-s-oo \ N 



lim E trivlog I L + 7 V*V 
lim / clog(l + jt) d^L{t) 



(42) 



clog(l +jt)d[i c {t) 

where /i^ is the empirical measure of the L x L random 
matrix V*V and /i c is the limit measure of the ^l- The first 
equality follows from Sylvester's Theorem on determinants, 
the second and third are by definition, and the final equality is 
a consequence of their uniform integrability. This latter follows 
from log (1 + "ft) < "ft, t > and that given e > 0, 3a > 
such that _ 

sup / tdfj,L(t) < e 

L J a 

see the converse statement in [7| Theorem 5.4. 
Therefore, by Jensen's inequality 

poo 

CV(7) = c / hg(l+ -ft) dfic(t) 
< clog(l + 7). 
since the limit first moment is 1. 

As an application of the above consider the network with M 
mobile users conducting synchronous multi-access to a base 
station with N antenna elements, arranged as a uniform linear 
array, |2T|. The network is depicted in Figure [3] showing the 
directions of arrival of two mobiles A and B. 
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1.25 - 



< 175 




0.5 



Fig. 3. Multi access network with scheduling with M mobile users 
conducting synchronous multi-access to a base station with N antenna 
elements, arranged as a uniform linear array. 



Fig. 4. Simulated limit distribution for ~ U[—ir, n] with L = N = 1000 
averaged over 700 sample matrices. 



Suppose a random subset of L users in any time slot are 
selected to transmit. Then the antenna array response over the 
selected users is V equals to 



V 



1 



,— 2-rriv sin( 







,-2iri(iV-l)4 



1 \ 



-2m(N-l)i 



<6 L ) J 

(43) 

where d is the element spacing and A is the wavelength, see 
also QJ. Let us suppose that M,L,N are large and that the 
angles of arrival are uniformly scattered in (—a, a). Then it 
is reasonable to determine performance supposing that the 
angles of arrival are drawn uniformly so that the maximum 
sum throughput (equivalently per user rate) is determined by 



( 42 1 with the phase pdf given as 

q a (0) = - 



2a 



iTT 2 d 2 

A 2 



9 2 



for 6 G 



27rdsina 27rdsina 



]. The above example is largely 



A ' A 

illustrative and a more realistic one would depict a network 
of users with heterogeneous received powers corresponding 
to varying mobile distances. Such generalizations as this and 
others can be treated using the results given here but we do 
not go into details. 

In Figure [9] we show the capacity for uniform phase and 
with the phase distribution density q a (8) corresponding to the 
uniform linear array with X = 2d and various values of a. 

VIII. Numerical Results 

A. Simulations for the Limiting Measure 

In this Section we present some numerical results and simu- 
lations. In Figure|4]we show the simulation results obtained for 
700 independent samples of a square matrix with N — 1000 



1.25 



~i 1 r 




Fig. 5. Simulated limit distribution for 8 ~ f(x), see j21| , with L = N 
1000 averaged over 700 sample matrices. 



rows. The plot shows the sample histogram for the eigenvalues. 
The results strongly suggest that there is an atom at in the 
limiting measure. As can be seen there is very little probability 
mass above 4 which is consistent with our bounds for the 
maximum eigenvalue. 

In the following Figure we consider the pdf given in equa- 
and the simulation described above was repeated. 



tion (21 



Our results are shown in Figure [5] The results are similar to 
the uniform case, in that an atom at is strongly suggested. 
Also the pdf possesses peakes at 1 and 2 as was found in the 
uniform case. It should be noted that the right tail is more 
spread out than before. 
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▼ - Marchenko Pastur Lower Bound 
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Fig. 6. Upper and lower bounds for m„ 
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TABLE II 
Moments and Moment Bounds 



n 


Cn 




mn 




4 


14 


14± 
9 


14* 


15 


5 


42 


46 * 


46 1 


52 


6 


132 


« 160.0928 


162.6358 


203 


7 


429 


« 579.1567 


619.6256 


877 




50 100 150 200 250 300 350 400 450 500 



B. Moment Bounds 



Fig. 7. Upper and lower Bounds for the maximum eigenvalue with simulation 
results. 



Figure [6] depicts the upper and lower bound for the limiting 
moments m n as derived in Section |Vl] The horizontal axis 
is the moment index and the vertical axis is the (natural) log 
of the bound. As the Figure shows, the eigenvalue moments 
lie much more closely to the Bell Number upper bound than 
they do to the bound corresponding to the Marchenko-Pastur 
distribution (MP), see also (T). Close inspection shows that 
the partition lower bound lies belows MP. This is because 
the asymptotic formula, based on the central limit theorem, 
is being used as opposed to the bound constructed from the 
peaks of uniform densities. The moments themselves are not 
depicted. 

In the following we use the more accurate version of the Fl §- 
bound see Table [I] Here n is the moment index, C n is the n-th 
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Maximum eigenvalue for the distribution p a (6). 



TABLE I 

Moments and Moment Bounds, d = 1 (Vandermonde) 



n 


Cn 


L n 


m n 


B n 


4 


14 


14- 




14- 
=-4 


15 


5 


42 


48 4 


48 1 


52 


6 


132 


ai 176.2944 


178.55 


203 


7 


429 


» 684.4611 


713.66667 


877 



Catalan number, L„ is our lower bound, m n the moment and 
B n the Bell number upper bound. 

We now present the corresponding results for the empirical 
eigenvalue measure from |2) when d = 2. As before, we 
use the more accurate version of the bound see table UJ] and 
with the same notation. The exact moments are obtained by 
squaring the values of the crossing partitions. For large d 
the Marchenko-Pastur limit is approached as the contribution 
of the crossing partitions goes to 0. As can be seen in this 
example the lower bound, L n , once again provides a much 
more accurate estimate of the moments than C n . 



C. Maximum Eigenvalue 

We now present results for the maximum eigenvalue A at. 
Figure [7] shows the theoretical upper and lower bounds, 
together with simulated results for ~ U(— tt, 7r). The results 
are for matrices with up to N — 500 and the sample mean 
values of the maximum eigenvalue were obtained using 10,000 
random matrices per point. As can be seen the results follow 
the lower bound closely. In a second experiment the bounded 
pdf (with two discontinuity points) was simulated, 

The unbounded pdf p a {x) see equation |20) i was also simu- 
lated for a — |, |, | and 0.9. The results are shown in Figure 

m 

D. Results for the Capacity 

We now consider the capacity of the limiting Vandermonde 
channel, shown to exist in Section |VII| Simulations were 
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Fig. 9. Capacity per channel use per degree of freedom. 
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Fig. 10. Distribution q a (8) with A = 2d, a ■ 



conducted for the uniform distribution and for the distribution 
with density 

q a (0) = - 



1 



2a 



in 2 d 2 
A 2 



2 



with a — | , ~ and ~ and with square matrices size N = 100 
and A = 2d. The distribution q a with a = J is depicted in 
Figure 10 The results are graphed in Figure [9] and show that 
the capacity diminishes as a becomes smaller. For the largest 
value a = ^ capacity is very close to that determined by the 
uniform which we included for reference. All curves lie below 
the Jensen inequality bound, log 2 (l + 7). 

IX. Conclusions 

The main results of this paper are upper and lower bounds 
for the maximum eigenvalue of random unit magnitude Van- 
dermonde matrices. Additionally, the limit measure was shown 
to exist for a wide class of densities. When the densities 
were not continuous it was required that the Fourier series 
coefficients be non-negative. This latter condition while it is 
sufficient appears far from necessary. 

Additional results include the existence of the capacity 
of the Vandermonde channel (limit integral for the expected 
log determinant). We also provide evidence to support a 



conjecture on the lower bound on the Vandermonde expansion 
coefficients. We also show that this conjecture implies a tight 
lower bound for the moment sequence. 

As far as the limit eigenvalue distribution is concerned we 
conjecture that there is an atom at and not other atoms. The 
size of this atom will of course depend on the distribution 
of the phases. This matter can be investigated numerically by 
examination of the fraction of eigenvalues near as the matrix 
dimensions go to infinity. 

Appendix A 

Elementary Lemma and Corollary regarding the 
eigenvalues of v*v 

We show that there is a real symmetric matrix which 
has the same eigenvalues as V*V where V is the random 
Vandermonde matrix. 

Lemma 3: Let A and B be N x N complex matrices and 
suppose that 

< '1 

(44) 



ce 



with Cfc for every fc = 1, 2, . . . , N. Then A and B have 
the same eigenvalues. 

Proof: Suppose that A is an eigenvalue of A with corre- 
sponding eigenvector v. Set the vector u as 

ue = c e v e . 

Multiplying u by B gives, 

^ B k; iue = c k ^2 Ak,ivi = \c k v k = Au fe . 
t £ 
Thus any eigenvalue of A is also an eigenvalue of B. Since 
also 

A k ,e = -^B kt£ (45) 
dt 

with dk = 1/cfe and k — 1, . . . , N, we find that all the 
eigenvalues of B are also eigenvalues of A mutatis mutandis. 



Corollary 2: The matrix Xn with entries 

/Wcfpi-*,-))^ 



has the same eigenvalues as V*V. 

Proof: Let a k i be the (A;, I) entry of the matrix V* V then 
it is easy to see that 



N-l 



(46) 



Hence 

1 + • • • + e-^-V* 
Substituting, 



p=0 

e -iNx/2 / e iNx/2 _ e -iNx/2 



g—ix/2 \ g— ix/2 

e -iNx/2 sm (7Va;/2) 



e~W 2 sin(x/2) 
x = 9 k - 6 e 
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the first term on the RHS of the previous equation is 

e iNe e /2 e id k /2 



e iNS k /2 e i8e/2 

and has the form given in Lemma [3] ■ 

Appendix B 
The proof of Lemma[2] 

Proof: By definition, 

r +00 

7 ( m -p)(t) 5 (p)(i)df = 5 M(0) 

and similarly for n. Also the functions g( mi '> (i), g( m ?) 
increase and decrease together for any integers rti\,m<i > 0. 
It follows immediately from the FKG inequalities [3] that, 

f(t)h(t)n(t) dt> J f(t)n{t)dt- J h(t)fi(t)dt 

where fi is a finite measure and /, h increase and decrease 
together. That the result holds, following on substituting 



/(<) 

h(t) 
M(t) 



= 9 

= 



(n-p) 



(t) 



9 {P) (t) 



Appendix C 
The proof of TheoremQ] 

Proof: Let p £ V{n) be a partition of n with r blocks. 
Let w be a probability measure with density p(x). Let Ei = 
Sfces i>k-\ ~ ik where Bi is the i-th block. We are required 
to show that, 

(47) 



K PtU1 = \iuxK PtUN 

' N 



where 



where 



K P ^. N = ^G^(m)[jE(e 



(48) 



k=l 



m := (mi, . . . , m r ) £ Zq 



with 



and 



and 



Z r := {(z lt ...,z r )£Z r : z x + ■ ■ ■ + z r = 0} 



GUm) 



N „ + l N 



Sn™ #{i = (H> • ■ • ,i n ) ■ Ei= mi, ...,E r = m r }. 

Note that Equation ( |48| is the expected trace evaluated for the 
partition p. 

In the special case where the phases 6's are uniform distributed 
on [— 7r, 7r], the coefficients of G^(m) are all except when 
m = 0. It follows then that, 

K p , u = lim G%{0) 



is the expansion coefficient of the uniform. To obtain the limit 
we proceed via the Lebesgue dominated convergence theorem, 



1 32 1, and note we are summing over m £ Zq. 



As far as pointwise convergence is concerned, by Lemma [5] 
and for any (mi, . . . , m r ) £ Zq the limit exists 

lim G% (m) = K p , u £ (0,1] 

independent of m = (mi, . . . , m r ). 

As far as the dominated part is concerned, first note that 

< G p N (m) < 1 
for all m so we only need to show that 

B 



(49) 



m fc=l 



where 



a(m) :=E(e im9k ) 



c p(a;) dx, 



since the phases 6i,...,9n are independent and identically 
distributed. By hypothesis a(m) > 0, thus convergence alone 
is sufficient. This is demonstrated below. An example of 
an unbounded pdfs on [— it, tt] which meet the Theorem's 
conditions is given in Lemma [T] 

Let p(n) = -^-a{ri). Using the fact that p £ C and applying 
Theorem 15.22 of fT2) repetedly we see that 



;(0) 



n a ( m,£ ) 

(mi ,. ..,m b )£^o '■• — l 



(2n) r pr (0) 

/>7T 

(27r) r - 1 / p r {x)dx. 



It follows that 



(mi ,.. .^m^G^Q k—1 



Therefore, 



K p ^ = Kp.u ■ ^iry- 1 f 



p(x) r dx. 



This finishes the proof. 



Remark 8: We observe that (17i holds if p £ I 1 . This 
condition however forces the density to be continuous | [T4| . 

We now show pointwise convergence for G^(m) with m 
fixed. 

Lemma 4: Suppose we are given a partition p with n vari- 
ables and r > 2 blocks and corresponding partition equations 
E p . Then amongst the n variables there is a subset 



such that l-F^-il 



T p r _ x C{1,-- - ,n} 
r — 1 and for each / £ J rP _ 1 

M f= E F f,kMk 
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where k £ {— 1,0,1} and there is one more term with 1 
than with — 1. Since the Mf are distinct these equations are 
independent. 

Lemma 5: Let Gat (mi, . . . , m r ) be defined as before and 
(mi , . . . , m r ) £ Zq. Then 

lim Gjv(wt, .... 77i r l = lim Gat(0, . . . , 0) = K„ u . 

JV-s-oo iV->-oo 

Proof: Given a N x N Vandermonde matrix and a par- 
tition p of {1, • • • , n} with r blocks there is a corresponding 
set of partition equations E\ = 0, E2 = 0, . . . , E r = as 
before. Lemma |4] shows that there is a set of r — 1 distinct 
indexes, J-f!_ 1 , such that for all v £ ^-v 



to 



E 



(50) 



Let m be a vector in G Z^. Now we want to solve a similar 
problem but where the equations are E\ — m\ , . . . , E r = m r 
and m = (mi, . . . ,m r ). Indeed, inspection of the proof of 
Lemma [4] shows us that there exist coefficients \i v (which are 
linear combinations of the m^) such that: 



It is convenient to treat the indexes Mf. for k — 1, . . . , n as 
if they were obtained as random i.i.d. uniform in {1, ... , TV}, 
taking each value with probability 1/N. Define the event 



i n ) : Ex = mi,...,E r = m r } (52) 
for m G . We therefore obtain the following display, 

qp,m 



£m := {i = (h, 

7E 

P{^m} 



TV" 
N r 

= ■ P(Mv + Mf G I N + ft v : v G F^) 

where Jjy = {1, . . . , N} and fi v as before. 

To complete the Lemma it remains to show that the limit, 

limP^M* +(J, v eI N +fi v : ve (53) 

exists and has the stated value. Define the centered and scaled 
random variables, 



(M fc - (N - l)/2) 
N 



for every k. Since the prelimit vector has independent 
components with distribution function, 



Fn,u{x) 



[Nx + (N — 1)/2J + 1 



N 



as N goes to infintity for every x £ 
that, 



|, |] we may deduce, 



U 



N 



u - u\ 



1 1 

2' 2 



F[U. 



N,v S 



1 1 

2' 2 



AT 



v £ T p r _ 



The latter probability converges to 

1 1- 



U v £ 



2' 2 



(54) 



(55) 



as — > 00, since the /i„ are fixed. This limit is independent 
of m and thus determines the expansion coefficient for the 
uniform as mentioned earlier. The Lemma is proved. ■ 
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as 7Y — > 00. It follows that the limit in Equation (53 1 is equal 
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